"The highlighted tokens are predominantly function words, affixes, or short morphemes in Thai, Hindi, and English, often marking grammatical relationships, conjunctions, pronouns, or forming part of set phrases and idiomatic expressions. These tokens are crucial for sentence structure, meaning, and cohesion, frequently appearing at clause boundaries or as connectors within and between sentences."
Score Type | Accuracy | Precision | Recall | F1 score | TPR | TNR | FPR | FNR |
---|---|---|---|---|---|---|---|---|
detection | 0.67 | 0.667 | 0.68 | 0.673 | 0.68 | 0.66 | 0.34 | 0.32 |
fuzz | 0.65 | 0.615 | 0.8 | 0.696 | 0.8 | 0.5 | 0.5 | 0.2 |